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3^ BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a data processing 
system capable of processing data of different kinds, 
such as code data representing characters and symbols 
and image data r epresenting image density. 

2. Description of the Prior Art 
In the case of processing data of different kinds such 

as code data representing characters, symbols, etc., and 
image data representing image density, there may be 
employed separate transmission channels for transmit* 
ting the respective kinds of data for data pr ocess i n g 
Such an arrangement is, however, undesirable since 
there are required plural transmission channels accord* 
ing to the kinds of data* leading to a high cost, particu- 
larly in the case of long-distance transmission. 

On the other hand, in the case of transmitting data of 
different kinds through a common transmission channel, 
it has been necessary to provide the receiving unit with 
a memory of a large capacity for storing ail the trans- 
mitted data in said m e mory and to inspect the stored 
data for identifying the kind thereof. Such an arrange- 
ment is not only cosrwise undesirable but also is unsuit- 
able for real-time processing since the idenoficaoou of 
data content requires tune. 
In either case, the aboveHnentioned drawbacks be- 
as the number of kinds of data in* 

SUMMARY OF THE INVENTION 

In consideration of the foregoing, an object of the 
present invention is to provide a dam processing system 
capable of transacting data of various kinds exactly, 
using a simple structure. 

Another object of the present invention is to provide 
a data jH'r erring system capable of identifying and 
proc rising, on a real-time bests, tranamitted data of 
different kinds. 

Still another object of the present invention is to 
provide a dam prrrnssing system capable of securely 
identifying and separating mixed data of different kinds. 

Still another object of the present invention is to 
provide a data processing system adapted for reproduc- 
tag a synthesized image from data of different kinds. 

object of the present invenoon is to 
i a data pi o oi s sing system capable of easily syu- 
symoosv etc, with an image read 
i doct 




The foreg o in g and still other objects of the present 
invention will become fully apparent from the follow- 
ing description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. tnfa block cuagram of a data trananussion sys- 
tem enibodying the prcisnt invention; 

FIG. 2 / at a .chart showing a data format; 

FIG. 3^a schematic view showing the structure of 
a front rnetnory; 

FIG. 4 r is s chart showing density patterns; 
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FIG. 3 i/a schematic view explaining the transmis- 
sion operation; 

FIG. 6 is a detailed block diagram o^a transmission 
station; 

FIG. 7, comprising FIGS. 7(a)-7(<f), is a schematic 
view showing examples of image and character intor- 
mation; / 

FIG. 8As a schematic view showing the state ot a 
layout memory; 

FIG. 9yis a detailed block diagram of a receiving 
station; and/ 

FIG. 10/u a block diagram showing another embodi- 
ment of the data transmission system. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 
Now the present invention will be clarified in greater 
detail by embodiments thereof shown in the attached 
drawings. 

FIG. 1 shows, in a block diagram, an embodiment ot 
the data transmission system employing the data trans- 
mission method of the present invention, wherein a 
transmitting station 1 is provided with an image reading 
unit 2 for photoelectrically reading a color-separated 
original image with an image sensor such as a charge- 
coupled device (CCD) to generate image data repre- 
senting the image density through the use of density 
patterns to be explained later, a document preparation 
unit 3 for forming character information composed of 
characters, symbols, etc., according to input data from 
keys or tablets to generate code data representing char- 
acters, symbols, etc, for example in the form of ASCII 
and a layout unit 4 for editing (for example by 
relocation, enlargement reduction, erasure, extraction, 
etc) the image data from the image reading unit 2 and 
the code data from the document preparation unit 3 
according to predetermined formats or according to 
mt ft ..«i instructions to be given from keys or a digitizer, 
and releasing or outputtmg the corresponding data. The 
A*** edited in the layout unit 4 are supplied to a trans- 
mission channel L composed for example of an optical 
fiber or a telephone line. Consequently the image data 
and the character code data are mixedly present on the 
transmission channel L. The transmission on the chan- 
nel L may be conducted either in the form of NRZ 
signals or in the form of modulated signals, for example 
MFM (modified frequency modulation) modulation. In 
this form the image information obtained from the origi- 
nal is not trans mitte d in its original form but in the form 
of data representing s density pattern, so that the effi- 
ciency of transmission is improved by the reduction in 
the quantity of transmission relating to such image in- 
formation. 

A receiving station 3 ftisrrimi— in s data discrimi- 
nating unit IX the data transmitted through the trans- 
ffi ^™* -h— 1«— i L by means of discrimination code of 4 
bits preceding said data, and the data are guided to a 
suitable processing circuit according to the result of said 
discrunination. More specifically, image data are sup- 
plied, through a buffer memory 6, to a pattern generator 
8 which stores, as shown in FIG. 4, 17 dot patterns 
Ltl p rftf m tiitg various densities by different arrangements 
of white and black dots in 4x4 matrix. On the other 
K«tw4, the code data are supplied, through a buffer mem- 
ory 7, to a character generator 9 equipped with a font 
memory storing fonts of characters, symbols, etc 

The output signals from the pattern generator 8 and 
from the character generator 9 are synthesized in a logic 
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sum circuit 10, and are supplied to a color printer 11, 
composed for example of an ink jet printer or a laser 
beam printer, for obtaining a colored record synthe- 
sized of characters, symbols, etc., and of images on a 
recording material such as paper, after suitable color 
signal processing such as complementary color conver- 
sion, background color removal etc. 

FIG. 2 shows an example of the format of data of a 
word transmitted on the transmis- 
sion channel L, charac- 
ters MSB and LSB identifying the most and least signifi- 
cant bits, respectively. The upper 4 bits AO- A3 consti- 
tute a discrimination code for identifying the data con- 
tent in the data discriminating unit 12, and the following 
bits DO-Dn constitute the code data or image data. 
More specifically, the discrimination code AO "0" indi- 
cates that the bits DO-Dn represent code data, and the 
code AO "1** j—j*—* ~ that said bits DO-Dn represent 
image data. 

If the discrimination code bit AO is **f\ representing 

image data, the bits DO-Dn represent 
any one of the 

density patterns composed of 4x 4 matrices per pixel as 
shown in FIG. 4. For example 5-bit data may be em- 
ployed for indicating the number of black dots in said 
4x4 matrix. In this case the information of 4x4» 16 
bits can be compressed to 5/16, with resulting improve- 
ment in the efficiency of transmission. Also, in the case 
that the discrimination code bit AO is "Or* represen ting 
the code data, the following 3 bits Al-AJ constitute an 
address code for the font memory in the character gen- 
erator 9. More specifically, in the case that a character 
or symbol is represented by a matrix of 32x32 dots as 
shown in FIG. X said matrix is divided, corresponding 
to the number of rows (4 dots) in each density pattern, 
into 8 groups L0-L7 each composed of 4x32 dots, and 
the discrimination code bits Al, AX A3 are used for 
selecting the groups L0-L7 in the font memory. For 
example, a code: 

A0A1AIAJD6O1D3 . . . Do-OOOCDOCX . . . X 

instructs an access, co r re sp onding to a character repre- 
sented by code data XXX ... X, to the font of the group 
La ue. the uppermost 4x32 dots, Also a code: 

ASA1A2AJD0D1D1 . . . Di-OOOlXXX ... X 

instructs an access, corresponding to a character repre- 
sented by code data XXX ... X to the font of the group 
LI, Le. 4x 32 dots from the 5th to 8th rows. Similarly 
the code bio AOAlAZA3-**0010r instructs an access 
to the group U, "001 r to the group L3, "01 (XT to the 
group LA ... i to the group L7. 

On the other hand, in the case that the discrimination 
code bit A0 si M V* reprc sr firing image data, the follow- 
ing 3 bets Al-AJ are used for designating the color of 
the image data rrprrsnnirrl by the bits DO-Dn. For 
example the code bin A0AlA2A3- M0fXr, "10HT, 
"1100" or "1110" respectively 
represent red, green, 
blue or black. Thus, a c od e: 

AOAlAXODSOtOl . . . Da-IOIQXXX X 

indiratrt that the input data are green image data of a 
density pattern corresponding to a brightness XXX . . . 
X. Also a code: 

AaAiAJAJDtDiDS . . Do-lllOXXX . . • X 
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indicates that the input data are black image data corre- 
sponding to a brightness XXX ... X. 

A discrimination code A0A1AJA3»"1 1 1 L" is used 
as a printer control signal such as a carnage return 
signal or a skip signal, regardless of the value of the 
following bits DO-Dn. 

The transmitting station 1 serially scans, wuh color 
separation, an original image to be transmitted by means 
of line image sensors to generate density data shown in 
FIG. 4 corresponding to the density information ob- 
tained in said scanning, and releases or outputs said 
density data OO-Dn after adding a bit AO* I represent- 
ing image data and color discriminating code bits 
f A1-A3 in the layout unit 4. On the other hand, in the 
case of transmitting characters, symbols, etc., as shown 
- in FIG. 1 a code train 401 stored in a memory corre- 
sponding to document information prepared in the doc* 
ument preparation unit 3 (FIG. 1) is serially taken out 
and stored in a register 402. Said code, stored in the 
register 402, is released after addition of a 3-bit code 
A1-A3 for addressing the font memory and a code bit 
AO - "tr representing a code data in the address genera- 
tor 403. The address generated by the address generator 
403 is stepwise increased at each entry of a pulse from a 
pulse generator 404 which is activated at each scanning, 
Le. at each entry of the carriage return signal, while the 
character code DO-Dn corresponding to plural charac- 
ters or symbols constituting a same line is repeatedly 
released 8 ■ 

Thua, in the mixed transmission of characters, sym- 
bols, etc., and i tn a gei , the receiving station can carry 
out the recording operation for the characters, symbols, 
etc., in the tame manner as for an image read from the 
original, since the font memory is accessed each time 
for a number of lines corresponding to the dimension of 
the unit pixel composed of a density pattern. 

In the receiving station, such received data may be 
stored in a magnetic or optical memory. Also the trans- 
mitted image data need not be limited to density pat- 
terns rrpif willing density levels, but can be data sub- 
jected to suitable data compression, for example com- 
pression by MH (modified Huffman) 
codes. In such case 
the tran smitting station is required to have a signal com- 
pressing circuit, while the receiving station is required 
to have a signal expanding circuit. Also the recording 
or storing operation may be conducted only on either of 
the kinds of transmitted data, since the separation 
thereof is quite easy 

Furthermore, the image data transmitted from the 
transmitting station may be obtained from a color tele- 
vision camera, or from an image memory such as a 
magnetic memory. Also the information composed of 
chara cters, symbola, etc, may be obtained for example 
from a word processor or an office computer. 

As exp la ine d in the foregoing, the image data and the 
code dam representing characters and symbols are ex- 
actly distinguished even when they are transmitted 
through a common tra n s mis s io n channel, and the char- 
acters or symbols can be handled in dimensionally com- 
patible manner. Also the present invention prevents the 
: " t ia cost since it does not require increase in the 
-a of the font memory but only in the number of 
i thereof. 

Naturally, the dimension of the 
font memory is not 

umtedi to 32x32 dots but may be suitably selected 
according to the output device such as the printer. 

The data of characters or symbols to be synthesized 
with the image data may be obtained not only from a 
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document preparation unit such as a word processor but 
also from an output device for releasing the time and 
dat* of transmission or a number indicating the numbers 
or pages of the original. 

Furthermore, the receiving station may show the 
synthesized image on a display unit such as a cathode 
ray rube, in addition to image recording on a recording 
material. 

Furthermore, the image data and the code data may 
be transmitted in a predetermined order on the transmis- 
sion channel, for example the image data at first in col- 
lective manner and then the code data also in collective 
manner. Naturally mined transmission in random. order 
is also possible. 

/FIG. 6 shows, in a block diagram, another embodi- 
ment of the transmitting station 1 shown in FIG. 1, 
wherein a reader unit 601 photoelectrically reads an 
original with color separation to generate color image 
signals of blue (B), green (G) and red (R\ while a word 
processor 602 equipped with a character/symbol input 
unit such as a keyboard for generating document infor- 
mation and releasing character code data corresponding 
to thus prepared document information. 

The color image signals released from the reader unit 
601 are supplied to a pattern data generator 603 for 
generating density pattern data for each of the entered 
color image signals. An image file 604, composed of a 
floppy disk or a semiconduc tor tn emory, can store 
ima^.data. composed of density pattern data* together 
with the color discTrrnrnanng codes (A1-A3), corre- 
spondmgjo_plural.rMges^f-theroriginaL 
'"On The other hand the character code data released 
from the word processor 602 are stored in a document 
file 60S similar to the above-mentioned image fue. 

FIG. 7, co mp risi ng FIGS. 7(a)-7(4), shows examples 
of image information PI, P2 read in the reader unit 601 
and stored in the image file, and of character informa- 
tion CI G2 prepared in the word processor 603 and 
stored in the document file. 

In FIG. 6, a layout conooller 606 performs layout 
functions such as rearrangement, change in magnifica- 
tion, erasure, etc., on the image information and charac- 
ter information supplied from the reader unit 601 and 
word processor 602, according to layout information to 
be supplied by the operator through a keyboard 607. 

The layout controller 606 is provided with a layout 
table for storing the layout information entered from 
the keyboard 607. Said layout table connpon ds to the 
recording area of the receiving station, as shown in 
FIG. 8. The layout table 901 shown in FIG. S illustrates 
an example of layout of the information shown in FIGS. 
7(a)-7(4)» wherein the image information PI is allotted 
to en area defined by points A and B, the image infor- 
meaion P2 to an area defined by points G and H, the 
cJuneaar information CI to an area defined by points E 
and Ft and the character infonnaoon C2 to an area 
defined by points C and O, while the margins outside 
said areas are left as white. 

At the transmission of said information subjected to 
the layout operation, the image file 604 and the docu- 
ment fue 605 release signals for each row, according to 
output uvtrucnons supplied from the layout controller. 
Identification code applying circuits 600, 609 attach the 
aforementioned data discruninating bit AO in front of 
the data respectively released from the image file 604 
and document file 606. 

Counters 610, 611 respectively count readout signals 
WP, WS for said files supplied from the layout control* 
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ler 606. A character position signal CS is used for set- 
ting the aforementioned bits A1-A3 indicating the ac- 
cess position to the font memory. 

In response to a transmission start signal. :he layout 
controller 606 starts the scanning of the iaycut table 
801. in a direction to the right from a point X shown in' 
FIG. 8 and finally reaching a point Y. Now let us con- 
sider a case of scanning from a point Ql to another point 
Q6. In a portion from the point Ql to a point Q2, not 
corresponding co an image or character layout area. :he 
layout controller 606 releases a blank signal (A0A1A- 
2A3D0D1 . . . Dn»Ull00 ... 0) indicating a white 
image, through a line 612. In a 
portion from the point 
Q2 to a point Q3, falling within a layout area for :he 
image information PI. there is output the image file 
readout signal WP, which is counted by the counter 610 
as explained before to release determined data from the 
image file 604 in response to said counting. In this man- 
ner the layout memory is scanned, and. when the scan- 
ning reaches the front end of the layout area PI. the 
signal WP is released to shift the counter 610 to a count 
'*r\ thereby releasing the image data of-the first line 
from the image file 604. Subsequently, when the scan- 
ning next reaches the layout area PI. the signal Wp is 
released again to shift the counter 610 to a count "*2'\ 
thereby releasing the image data of the second line from 
the image file 604. In this manner the count of the 
counter 610 is stepwise advanced every time the scan- 
ning reaches the layout area, thereby selecting the row 
of the image data to be read from the image file 604. 

In a portion from the point Q3 to a point Q4. again 
corresponding to a non-layout area, the layout control- 
ler 606 again releases the aforementioned blank signal. 

In a succeeding portion from the point Q4 to a point 
Q3, co rr e sp ond i ng to a Layout area of the character 
information CI, the layout controller 606 releases a 
document file readout signal WS, which is counted by a 
counter 611 to release determined data from the docu- 
ment file 605. In the present embodiment the font mem- 
ory is divided into 3 groups (L0-L7) for successive 
arr^w^ so that the stepwise increment of the counter 
611 takes place after counting the signal WS eight times 
to release the character code data corresponding to a 
inn ruling row of characters from the document file 
608. A signal CS, for designating groups (positions) in 
the font memory, is used for attaching position codes 
(A1-A3) to the character code data obtained by said 
access, according to the count of the counter 611. 

In a portion from the point Q5 to the point Q6, corre- 
sponding to a non-layout area, the layout controller 606 
releases the aforementioned blank signal. When the 
scanning reaches the point Q6, i.e. the right-hand end of 
the layout table 801, the layout controller 606 releases 
the carriage return signal through a line 612. 

Thus, in the course of raster scanning of the layout 
table 801, the layout controller 606 releases the readout 
signal WP or WS r e sp ect i vely when said scanning 
reaches an image layout area or a character layout area, 
thereby causing data readout from the image file 604 or 
the document file 606. In this manner there is obtained 
information containing the image data and the character 
code data in mixed manner. Said counters 610, 611 are 
cleared at the rear end of the layout area. 

FIG. 9 shows, in a block diagram, another embodi- 
ment of the receiving station shown in FIG. 1, adapted 
for receiving the data transmitted from the transmitting 
station shown in FIG. 6 and recording a synthesized 
image on the recording material. 
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The data transmitted from the transmitting station are 
entered into a shift register 901. Upon said data being 
entered in the register 901, the first four bits (AO- A3) 
are supplied to a decoder 902, which discriminates, 
from said discrimination codes AO- A3, whether the 
succeeding data bits DO- On represent image data, char- 
/acter code or a printer control signal, and releases addi- 
/ tional data such as color data in case of image data, or 
/ data on access position to the font memory in case of 
{ character code data. 

If discrimination code A0A1A2A3- M1 1 r is de- 
tected by decoder 901. then output line 01 is activated. 
As previously described with reference to FIG. 1, this 
code is used as a printer control signal such as a carriage 
return signal or a skip signal, and is applied to printer 
control 913. 

An output line 00 of the decoder 902 is activated 
when the succeeding data bits DO-Dn are identified to 
represent character code data, while an output line 010 
is activated when said bits DO-Dn are identified to 
represent image data. Said output signals 09. 010 respec- 
tively enable buffer memories 904* 903 to store the data 
DO-Dn in the shift register 901. In this manner the 
decoder discriminate the nature of the data to select a 
suitable buffer memory, thus classifying the data. 

In case of the discriminarion code A0« M l M indicating 
that the following data DO-Dn are image data, the 
buffer memory 903 is enabled by the output 010 of the 
/decoder 902, thus accepting the data DO-Dn. Also the 
/ decoder 902 identifies the color of said data DO-Dn 
V from the discrimination codes A1-A3 to release cot re* 
^spending output signal 02, 09, 06 or 08 respectively 
mrticarrng blue, green, red or black. Said output signals 
02-08 respectively enable memories 900-911 for respec- 
dve colors for data reception. 
It The image data stored in the buffer memory 903, 
1 1 representing the white/black dot ratio per unit area as 
explained before, are supplied to a pattern generator 
908, which is provided with a table containing 17 pat- 
terns shown in FIG. 4 and releases a dot pattern corre- 
sponding to the input image data. Said dot pattern cor- 
responds to the signal yellow (Y), magenta (M) or cyan 
(Q obtained by complementary color conversion from 
the signals B, G, R. 

The dot pattern released from the pattern generator 
908 is stored in one of the memoiies 900-911 which are 
s ele ct e d by the output signals 02-09 of the decoder 902 
as cxplamrd before, 

On the other hand, in case of the discrimination code 
A0«B**Qr indicating that the following data DO-Dn are 
character code data, the buffer memory 904 accepts said 
data DO-De in r e apouae to the output signal 09 from the 
dec od er 90X The decoder 902 also identifies the group 
of the font ssssnory un d er access from the discrimina- 
tion codes Al-AJ, and releases output signals 08-00 
indicating said group. 

Said output signals 06-08 are stored in a buffer mem- 
ory 907 enabled by the output signal 09 of the decoder 
902. 

The data stored in the buffer memory 900 are sup- 
plied then to a character generator 900 storing charac- 
ter font, thus making access to a character indies ted by 
the data DO-Dn. On the other hand the buffer memory 
907 jnriirstri a position in the character, so chat the 
character generator 906 releases dot data of a deter- 
mined position of a character selected by the data 
DO-Dn. In the present embodiment the characters are 
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recorded in black, so that the dot data from the charac- 
ter generator 906 are stored uTthe black memory 911. 

As explained In the foregoing, the data DO-Dn en- 
tered in the shift register 901 are discriminated is to 
whether they represent image data or character code 
data, and are stored in the memories 908-9 U alter con- 
version into dot patterns by processes according to the 
results of said discrimination. 

When dot data of at least a line are stored in the 
memories 908-911. said data are supplied to a printer 
912 which, under control of printer control 913, exe- 
cutes color recording in the known manner according 
to the dot data Y, M, K stored in said memories 
908-911. and synthesizing the characters and the image 
read from the original 

In the foregoing and following embodiments the data 
of different kinds are transmitted through a common 
transmission c h a nnel , but some of the present invention 
are applicable to a case in which a synthesized image is 
produced from the information of different kinds trans- 
mitted through diff er e n t transmission channels. Also 
the data of different lands may be transmitted in a ran- 
dom order or in a predetermined order. 

FIG. 10 shows another embodiment in a block dia- 
gram, wherein the image information obtained by read- 
ing an original is transmitted not in density patterns but 
in signals compressed by modified Huffman (MH) pro- 
cess. 

In FIG. 10, a reader 101 photoelectrical^ reads an 
original to be transmitted with an image sensor such as 
a charge-coupled device (CCD) to generate binary 
signals representing black and white pixels in the unit of 
a line. The serial binary signals released from the reader 
101 are subjected to one-dimensional MH compression 
in an MH encorlrr 102 and are stored in an image file 
103 composed for example of a floppy- disk. On the 
other hand, character data prepared in a word proces- 
sor 104 are stored, in the form of ASCII codes, in a 
document file 108. 

A layout controller 108 performs the layout of the 
image and the characters according to the instruction of 
the operator or to a determined format as explained 
before, thus controlling the output from the image file 
103 and front the document file 10S and supplying the 
compr e ss ed image data and character code data in suc- 
cession to a transmission channel 107. The discrimina- 
tion codes as explained before are attached to the front 
end of each data. 

A discrimination circuit 108 identifies, by the discrim- 
ination codes, the data transmitted through the trans- 
mission channel 107 and guides said data to an appropri- 
ate processing circuit. 

The compressed image data are supplied, through a 
buffer memory 109, to an MH decoder 110 for expan- 
sion and converted into dot patterns. On the other hand, 
the character code data are supplied through a buffer 
memory 111 to a character generator 112 for conver- 
sion into dot patterns by means of a font memory. 

The dot pattern data supplied from said MH decoder 
110 and character generator 112 are synthesized in a 
logic sum circui t 113 and supplied to a prater 114 for 
image recording onto a recording material, in the layout 
selected by the layout controller 108 and synthesized 
from the image read in the reader 101 and the characters 
entered by the word processor 104. 

Also in the present embodiment, the reader may be 
replaced by an image information output device such as 
an electronic rile, and the word processor may be re- 
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